title: Experimental Investigation of Electromagnetically Induced Transparency in Selective Reflection Spectra

abstract: We have investigated electromagnetically induced transparency in the spectrum of selective reflection at the interface of Rb atom vapors and a dielectric nanocell window. A nanocell with atomic vapor column thicknesses ranging from 150 to 1200 nm, as well as a 50~$\mu$m thickness microcell were used. We have compared electromagnetically induced transparency observed for the cases of the selective reflection and transmission. It was demonstrated that for the thicknesses of below $\leq 1000$ nm selective reflection technique is more favorable. In contrast, for wider cells and microcells, using transmitted radiation as probe field is more effective.


title: ICM Ensemble with Novel Betting Functions for Concept Drift

abstract: This study builds upon our previous work by introducing a refined Inductive Conformal Martingale (ICM) approach for addressing Concept Drift (CD). Specifically, we enhance our previously proposed CAUTIOUS betting function to incorporate multiple density estimators for improving detection ability. We also combine this betting function with two base estimators that have not been previously utilized within the ICM framework: the Interpolated Histogram and Nearest Neighbor Density Estimators. We assess these extensions using both a single ICM and an ensemble of ICMs. For the latter, we conduct a comprehensive experimental investigation into the influence of the ensemble size on prediction accuracy and the number of available predictions. Our experimental results on four benchmark datasets demonstrate that the proposed approach surpasses our previous methodology in terms of performance while matching or in many cases exceeding that of three contemporary state-of-the-art techniques.


title: Rigidity of convex hypersurfaces, Rigidity of convex hypersurfaces in multidimensional spaces of constant curvature

abstract: In 1972, E. P. Senkin generalized the celebrated theorem of A. V. Pogorelov on unique determination of compact convex surfaces by their intrinsic metrics in the Euclidean 3-space $E^3$ to higher dimensional Euclidean spaces $E^{n+1}$ under a mild assumption on the smoothness of the hypersurface. In this paper, we remove this assumption and thus establish this rigidity result for arbitrary compact, convex hypersurfaces in $E^{n+1}$, $n \ge 3$. We also prove the corresponding results in other model spaces of constant curvature.


title: Rethinking the Diffusion Models for Numerical Tabular Data Imputation from the Perspective of Wasserstein Gradient Flow

abstract: Diffusion models (DMs) have gained attention in Missing Data Imputation (MDI), but there remain two long-neglected issues to be addressed: (1). Inaccurate Imputation, which arises from inherently sample-diversification-pursuing generative process of DMs. (2). Difficult Training, which stems from intricate design required for the mask matrix in model training stage. To address these concerns within the realm of numerical tabular datasets, we introduce a novel principled approach termed Kernelized Negative Entropy-regularized Wasserstein gradient flow Imputation (KnewImp). Specifically, based on Wasserstein gradient flow (WGF) framework, we first prove that issue (1) stems from the cost functionals implicitly maximized in DM-based MDI are equivalent to the MDI's objective plus diversification-promoting non-negative terms. Based on this, we then design a novel cost functional with diversification-discouraging negative entropy and derive our KnewImp approach within WGF framework and reproducing kernel Hilbert space. After that, we prove that the imputation procedure of KnewImp can be derived from another cost functional related to the joint distribution, eliminating the need for the mask matrix and hence naturally addressing issue (2). Extensive experiments demonstrate that our proposed KnewImp approach significantly outperforms existing state-of-the-art methods.


title: AllMatch: Exploiting All Unlabeled Data for Semi-Supervised Learning

abstract: Existing semi-supervised learning algorithms adopt pseudo-labeling and consistency regulation techniques to introduce supervision signals for unlabeled samples. To overcome the inherent limitation of threshold-based pseudo-labeling, prior studies have attempted to align the confidence threshold with the evolving learning status of the model, which is estimated through the predictions made on the unlabeled data. In this paper, we further reveal that classifier weights can reflect the differentiated learning status across categories and consequently propose a class-specific adaptive threshold mechanism. Additionally, considering that even the optimal threshold scheme cannot resolve the problem of discarding unlabeled samples, a binary classification consistency regulation approach is designed to distinguish candidate classes from negative options for all unlabeled samples. By combining the above strategies, we present a novel SSL algorithm named AllMatch, which achieves improved pseudo-label accuracy and a 100\% utilization ratio for the unlabeled data. We extensively evaluate our approach on multiple benchmarks, encompassing both balanced and imbalanced settings. The results demonstrate that AllMatch consistently outperforms existing state-of-the-art methods.


title: TP-DRSeg: Improving Diabetic Retinopathy Lesion Segmentation with Explicit Text-Prompts Assisted SAM

abstract: Recent advances in large foundation models, such as the Segment Anything Model (SAM), have demonstrated considerable promise across various tasks. Despite their progress, these models still encounter challenges in specialized medical image analysis, especially in recognizing subtle inter-class differences in Diabetic Retinopathy (DR) lesion segmentation. In this paper, we propose a novel framework that customizes SAM for text-prompted DR lesion segmentation, termed TP-DRSeg. Our core idea involves exploiting language cues to inject medical prior knowledge into the vision-only segmentation network, thereby combining the advantages of different foundation models and enhancing the credibility of segmentation. Specifically, to unleash the potential of vision-language models in the recognition of medical concepts, we propose an explicit prior encoder that transfers implicit medical concepts into explicit prior knowledge, providing explainable clues to excavate low-level features associated with lesions. Furthermore, we design a prior-aligned injector to inject explicit priors into the segmentation process, which can facilitate knowledge sharing across multi-modality features and allow our framework to be trained in a parameter-efficient fashion. Experimental results demonstrate the superiority of our framework over other traditional models and foundation model variants.


title: Unveiling and Harnessing Hidden Attention Sinks: Enhancing Large Language Models without Training through Attention Calibration

abstract: Attention is a fundamental component behind the remarkable achievements of large language models (LLMs). However, our current understanding of the attention mechanism, especially regarding how attention distributions are established, remains limited. Inspired by recent studies that explore the presence of attention sink in the initial token, which receives disproportionately large attention scores despite their lack of semantic importance, this work delves deeper into this phenomenon. We aim to provide a more profound understanding of the existence of attention sinks within LLMs and to uncover ways to enhance the achievable accuracy of LLMs by directly optimizing the attention distributions, without the need for weight finetuning. Specifically, this work begins with comprehensive visualizations of the attention distributions in LLMs during inference across various inputs and tasks. Based on these visualizations, to the best of our knowledge, we are the first to discover that (1) attention sinks occur not only at the start of sequences but also within later tokens of the input, and (2) not all attention sinks have a positive impact on the achievable accuracy of LLMs. Building upon our findings, we propose a training-free Attention Calibration Technique (ACT) that automatically optimizes the attention distributions on the fly during inference in an input-adaptive manner. Extensive experiments validate that ACT consistently enhances the accuracy of various LLMs across different applications. Specifically, ACT achieves an average improvement of up to 7.30% in accuracy across different datasets when applied to Llama-30B. Our code is available at https://github.com/GATECH-EIC/ACT.


title: Continual Learning with Diffusion-based Generative Replay for Industrial Streaming Data

abstract: The Industrial Internet of Things (IIoT) integrates interconnected sensors and devices to support industrial applications, but its dynamic environments pose challenges related to data drift. Considering the limited resources and the need to effectively adapt models to new data distributions, this paper introduces a Continual Learning (CL) approach, i.e., Distillation-based Self-Guidance (DSG), to address challenges presented by industrial streaming data via a novel generative replay mechanism. DSG utilizes knowledge distillation to transfer knowledge from the previous diffusion-based generator to the updated one, improving both the stability of the generator and the quality of reproduced data, thereby enhancing the mitigation of catastrophic forgetting. Experimental results on CWRU, DSA, and WISDM datasets demonstrate the effectiveness of DSG. DSG outperforms the state-of-the-art baseline in accuracy, demonstrating improvements ranging from 2.9% to 5.0% on key datasets, showcasing its potential for practical industrial applications.


title: Reducibility points and characteristic $p$ local fields I- Simple supercuspidal representations of symplectic groups

abstract: Let $F$ be a non-Archimedean local field with odd characteristic $p$. Let $N$ be a positive integer and $G=Sp_{2N}(F)$. By work of Lomel\'i on $\gamma$-factors of pairs and converse theorems, a generic supercuspidal representation $\pi$ of $G$ has a transfer to a smooth irreducible representation $\Pi_\pi$ of $GL_{2N+1}(F)$. In turn the Weil-Deligne representation $\Sigma_\pi$ associated to $\Pi_\pi$ by the Langlands correspondence determines a Langlands parameter $\phi_\pi$ for $\pi$. That process produces a Langlands correspondence for generic cuspidal representations of $G$. In this paper we take $\pi$ to be simple in the sense of Gross and Reeder, and from the explicit construction of $\pi$ we describe $\Pi_\pi$ explicitly. The method we use is the same as in our previous paper arXiv:2310.20455, where we treated the case where $F$ is a $p$-adic field, and $\pi$ a simple supercuspidal representation of $G=Sp_{2N}(F)$. It relies on a criterion due to Moeglin on the reducibility of representations parabolically induced from $GL_M(F)\times G$ for varying positive integers $M$. We extend this criterion to the case when $F$ has any positive characteristic. The main new feature consists in relating reducibility to $\gamma$-factors for pairs.


title: MR-MLLM: Mutual Reinforcement of Multimodal Comprehension and Vision Perception

abstract: In recent years, multimodal large language models (MLLMs) have shown remarkable capabilities in tasks like visual question answering and common sense reasoning, while visual perception models have made significant strides in perception tasks, such as detection and segmentation. However, MLLMs mainly focus on high-level image-text interpretations and struggle with fine-grained visual understanding, and vision perception models usually suffer from open-world distribution shifts due to their limited model capacity. To overcome these challenges, we propose the Mutually Reinforced Multimodal Large Language Model (MR-MLLM), a novel framework that synergistically enhances visual perception and multimodal comprehension. First, a shared query fusion mechanism is proposed to harmonize detailed visual inputs from vision models with the linguistic depth of language models, enhancing multimodal comprehension and vision perception synergistically. Second, we propose the perception-enhanced cross-modal integration method, incorporating novel modalities from vision perception outputs, like object detection bounding boxes, to capture subtle visual elements, thus enriching the understanding of both visual and textual data. In addition, an innovative perception-embedded prompt generation mechanism is proposed to embed perceptual information into the language model's prompts, aligning the responses contextually and perceptually for a more accurate multimodal interpretation. Extensive experiments demonstrate MR-MLLM's superior performance in various multimodal comprehension and vision perception tasks, particularly those requiring corner case vision perception and fine-grained language comprehension.


title: Humas: A Heterogeneity- and Upgrade-aware Microservice Auto-scaling Framework in Large-scale Data Centers

abstract: An effective auto-scaling framework is essential for microservices to ensure performance stability and resource efficiency under dynamic workloads. As revealed by many prior studies, the key to efficient auto-scaling lies in accurately learning performance patterns, i.e., the relationship between performance metrics and workloads in data-driven schemes. However, we notice that there are two significant challenges in characterizing performance patterns for large-scale microservices. Firstly, diverse microservices demonstrate varying sensitivities to heterogeneous machines, causing difficulty in quantifying the performance difference in a fixed manner. Secondly, frequent version upgrades of microservices result in uncertain changes in performance patterns, known as pattern drifts, leading to imprecise resource capacity estimation issues. To address these challenges, we propose Humas, a heterogeneity- and upgrade-aware auto-scaling framework for large-scale microservices. Firstly, Humas quantifies the difference in resource efficiency among heterogeneous machines for various microservices online and normalizes their resources in standard units. Additionally, Humas develops a least squares density-difference (LSDD) based algorithm to identify pattern drifts caused by upgrades. Lastly, Humas generates capacity adjustment plans for microservices based on the latest performance patterns and predicted workloads. The experiment results conducted on 50 real microservices with over 11,000 containers demonstrate that Humas improves resource efficiency and performance stability by approximately 30.4% and 48.0%, respectively, compared to state-of-the-art approaches.


title: Fault-tolerant control of random switching topology multi-agent system based on event triggering

abstract: In this paper, the formation control of multi-agent systems in random switching communication topology is studied, and the problem of excessive bandwidth and low control efficiency among multi-agents is solved. For nonlinear multi-agent systems, a sliding mode formation control algorithm with event-triggered random switching communication topology is proposed. Firstly, a fault-tolerant control strategy based on stochastic system model is designed to solve the problem of low controller efficiency and controller failure during the formation of multi-agent systems. Compared with the traditional multi-agent system dynamic model, the stochastic system model has stronger universality, which improves the efficiency of the controller. Secondly, in order to deal with the problem of high communication load and frequency between agents during formation in random switching communication topology, the sample-based event triggering controller is introduced into the controller, which effectively reduces the communication frequency and reduces the impact of communication delay. Finally, the stability and robustness of event-triggered random switching topology formation control are verified by computer simulation.


title: HCQA @ Ego4D EgoSchema Challenge 2024

abstract: In this report, we present our champion solution for Ego4D EgoSchema Challenge in CVPR 2024. To deeply integrate the powerful egocentric captioning model and question reasoning model, we propose a novel Hierarchical Comprehension scheme for egocentric video Question Answering, named HCQA. It consists of three stages: Fine-grained Caption Generation, Context-driven Summarization, and Inference-guided Answering. Given a long-form video, HCQA captures local detailed visual information and global summarised visual information via Fine-grained Caption Generation and Context-driven Summarization, respectively. Then in Inference-guided Answering, HCQA utilizes this hierarchical information to reason and answer given question. On the EgoSchema blind test set, HCQA achieves 75% accuracy in answering over 5,000 human curated multiple-choice questions. Our code will be released at https://github.com/Hyu-Zhang/HCQA.


title: Center and radius of a subset of metric space

abstract: In this paper, we introduce a notion of the center and radius of a subset A of metric space X. In the Euclidean spaces, this notion can be seen as the extension of the center and radius of open/closed balls. The center and radius of a finite product of subsets of metric spaces, and a finite union of subsets of a metric space are also determined. For any subset A of metric space X, there is a natural question to identify the open balls of X with the largest radius that are entirely contained in A. To answer this question, we introduce a notion of quasi-center and quasi-radius of a subset A of metric space X. We prove that the center of the largest open balls contained in A belongs to the quasi-center of A, and its radius is equal to the quasi-radius of A. In particular, for the Euclidean spaces, we see that the center of largest open balls contained in A belongs to the center of A, and its radius is equal to the radius of A.


title: Theoretical predictions for $t{\bar t}W$ cross sections at approximate N$^3$LO

abstract: We present theoretical calculations of higher-order QCD and electroweak corrections for the associated production of a top-antitop quark pair and a $W$ boson ($t{\bar t}W$ production) at LHC energies. We show predictions for cross sections at approximate N$^3$LO (aN$^3$LO) which include second-order and third-order soft-gluon corrections added to the exact NLO QCD+electroweak result. We compare our results to recent measurements from the LHC, and we find that our predictions provide improved agreement with the data. We also calculate the top-quark transverse momentum and rapidity distributions in $t{\bar t}W$ production. We find significant enhancements from the higher-order corrections to the total and differential cross sections for this process.


title: Observation Time Difference: an Online Dynamic Objects Removal Method for Ground Vehicles

abstract: In the process of urban environment mapping, the sequential accumulations of dynamic objects will leave a large number of traces in the map. These traces will usually have bad influences on the localization accuracy and navigation performance of the robot. Therefore, dynamic objects removal plays an important role for creating clean map. However, conventional dynamic objects removal methods usually run offline. That is, the map is reprocessed after it is constructed, which undoubtedly increases additional time costs. To tackle the problem, this paper proposes a novel method for online dynamic objects removal for ground vehicles. According to the observation time difference between the object and the ground where it is located, dynamic objects are classified into two types: suddenly appear and suddenly disappear. For these two kinds of dynamic objects, we propose downward retrieval and upward retrieval methods to eliminate them respectively. We validate our method on SemanticKITTI dataset and author-collected dataset with highly dynamic objects. Compared with other state-of-the-art methods, our method is more efficient and robust, and reduces the running time per frame by more than 60$\%$ on average.


title: On well-posedness for parabolic Cauchy problems of Lions type with rough initial data

abstract: We establish a complete picture for well-posedness of parabolic Cauchy problems with time-independent, uniformly elliptic, bounded measurable complex coefficients. We exhibit a range of $p$ for which tempered distributions in homogeneous Hardy--Sobolev spaces $\dot{H}^{s,p}$ with regularity index $s \in (-1,1)$ are initial data. Source terms of Lions' type lie in weighted tent spaces, and weak solutions are built with their gradients in weighted tent spaces as well. A similar result can be achieved for initial data in homogeneous Besov spaces $\dot{B}^{s}_{p,p}$.


title: Simulation of high-performance memory allocators

abstract: For the last thirty years, a large variety of memory allocators have been proposed. Since performance, memory usage and energy consumption of each memory allocator differs, software engineers often face difficult choices in selecting the most suitable approach for their applications. To this end, custom allocators are developed from scratch, which is a difficult and error-prone process. This issue has special impact in the field of portable consumer embedded systems, that must execute a limited amount of multimedia applications, demanding high performance and extensive memory usage at a low energy consumption. This paper presents a flexible and efficient simulator to study Dynamic Memory Managers (DMMs), a composition of one or more memory allocators. This novel approach allows programmers to simulate custom and general DMMs, which can be composed without incurring any additional runtime overhead or additional programming cost. We show that this infrastructure simplifies DMM construction, mainly because the target application does not need to be compiled every time a new DMM must be evaluated and because we propose a structured method to search and build DMMs in an object-oriented fashion. Within a search procedure, the system designer can choose the "best" allocator by simulation for a particular target application and embedded system. In our evaluation, we show that our scheme delivers better performance, less memory usage and less energy consumption than single memory allocators.


title: ISS-Scenario: Scenario-based Testing in CARLA

abstract: The rapidly evolving field of autonomous driving systems (ADSs) is full of promise. However, in order to fulfil these promises, ADSs need to be safe in all circumstances. This paper introduces ISS-Scenario, an autonomous driving testing framework in the paradigm of scenario-based testing. ISS-Scenario is designed for batch testing, exploration of test cases (e.g., potentially dangerous scenarios), and performance evaluation of autonomous vehicles (AVs). ISS-Scenario includes a diverse simulation scenario library with parametrized design. Furthermore, ISS-Scenario integrates two testing methods within the framework: random sampling and optimized search by means of a genetic algorithm. Finally, ISS-Scenario provides an accident replay feature, saving a log file for each test case which allows developers to replay and dissect scenarios where the ADS showed problematic behavior.


title: ObjectNLQ @ Ego4D Episodic Memory Challenge 2024

abstract: In this report, we present our approach for the Natural Language Query track and Goal Step track of the Ego4D Episodic Memory Benchmark at CVPR 2024. Both challenges require the localization of actions within long video sequences using textual queries. To enhance localization accuracy, our method not only processes the temporal information of videos but also identifies fine-grained objects spatially within the frames. To this end, we introduce a novel approach, termed ObjectNLQ, which incorporates an object branch to augment the video representation with detailed object information, thereby improving grounding efficiency. ObjectNLQ achieves a mean R@1 of 23.15, ranking 2nd in the Natural Language Queries Challenge, and gains 33.00 in terms of the metric R@1, IoU=0.3, ranking 3rd in the Goal Step Challenge. Our code will be released at https://github.com/Yisen-Feng/ObjectNLQ.


title: Representation in $C(K)$ by Lipschitz functions

abstract: The isometric universality of the spaces $C(K)$ for $K$ a non scattered Hausdorff compact does not take into account the ``quality'' of the representation. Indeed, the existence of an isometric copy of a separable Banach space $X$ into $C(K)$ made of regular enough functions, say Lipschitz with respect to a lower semicontinuous metric defined on $K$, imposes severe restrictions to both $X$ and $K$. In this paper, we present a systematic treatment of the representation of Banach spaces into $C(K)$ by Lipschitz functions improving previous results of the author.


title: Triple Helix synergy and patent dynamics. Cross country compartison

abstract: We use a computationally efficient technique of Logistic Continuous Wavelet transform (CWT) to analyze patent data for Switzerland, Germany, USA, and Brszil for the period 1980-2000. We found that patent growth dynamics follows the dynamics of innovation system synergy in the framework of Triple Helix model of innovations where observed non-linear actors' interactions are provided by biased information exchange between heterogenious actors. Suggested approach reveals the latent trend structure in patent and innovation dynamics and may help policymakers identify the potential drivers of patent and innovation activity and form informed policy for boosting innovation development. The paper also privides a foundation for future research in differnt fields studying complex systems of interacting heterogenious agents.


title: DABL: Detecting Semantic Anomalies in Business Processes Using Large Language Models

abstract: Detecting anomalies in business processes is crucial for ensuring operational success. While many existing methods rely on statistical frequency to detect anomalies, it's important to note that infrequent behavior doesn't necessarily imply undesirability. To address this challenge, detecting anomalies from a semantic viewpoint proves to be a more effective approach. However, current semantic anomaly detection methods treat a trace (i.e., process instance) as multiple event pairs, disrupting long-distance dependencies. In this paper, we introduce DABL, a novel approach for detecting semantic anomalies in business processes using large language models (LLMs). We collect 143,137 real-world process models from various domains. By generating normal traces through the playout of these process models and simulating both ordering and exclusion anomalies, we fine-tune Llama 2 using the resulting log. Through extensive experiments, we demonstrate that DABL surpasses existing state-of-the-art semantic anomaly detection methods in terms of both generalization ability and learning of given processes. Users can directly apply DABL to detect semantic anomalies in their own datasets without the need for additional training. Furthermore, DABL offers the capability to interpret the causes of anomalies in natural language, providing valuable insights into the detected anomalies.


title: A Local Search Algorithm for MaxSMT(LIA)

abstract: MaxSAT modulo theories (MaxSMT) is an important generalization of Satisfiability modulo theories (SMT) with various applications. In this paper, we focus on MaxSMT with the background theory of Linear Integer Arithmetic, denoted as MaxSMT(LIA). We design the first local search algorithm for MaxSMT(LIA) called PairLS, based on the following novel ideas. A novel operator called pairwise operator is proposed for integer variables. It extends the original local search operator by simultaneously operating on two variables, enriching the search space. Moreover, a compensation-based picking heuristic is proposed to determine and distinguish the pairwise operations. Experiments are conducted to evaluate our algorithm on massive benchmarks. The results show that our solver is competitive with state-of-the-art MaxSMT solvers. Furthermore, we also apply the pairwise operation to enhance the local search algorithm of SMT, which shows its extensibility.


title: Feedback-driven quantum reservoir computing for time-series analysis

abstract: Quantum reservoir computing (QRC) is a highly promising computational paradigm that leverages quantum systems as a computational resource for nonlinear information processing. While its application to time-series analysis is eagerly anticipated, prevailing approaches suffer from the collapse of the quantum state upon measurement, resulting in the erasure of temporal input memories. Neither repeated initializations nor weak measurements offer a fundamental solution, as the former escalates time complexity while the latter restricts the information extraction from the Hilbert space. To address this issue, we propose a feedback-driven QRC framework. This methodology employs projective measurements on all qubits for unrestricted access to the quantum state, with the measurement outcomes subsequently fed back into the reservoir to restore the memory of prior inputs. We demonstrate that our QRC successfully acquires the fading-memory property through the feedback, a critical element in time-series processing. Notably, analysis of measurement trajectories reveal three distinct phases depending on the feedback strength, with the memory performance maximized at the edge of chaos. We also evaluate the predictive capabilities of our QRC, demonstrating its suitability for forecasting signals originating from quantum spin systems.


title: Data Issues in Industrial AI System: A Meta-Review and Research Strategy

abstract: In the era of Industry 4.0, artificial intelligence (AI) is assuming an increasingly pivotal role within industrial systems. Despite the recent trend within various industries to adopt AI, the actual adoption of AI is not as developed as perceived. A significant factor contributing to this lag is the data issues in AI implementation. How to address these data issues stands as a significant concern confronting both industry and academia. To address data issues, the first step involves mapping out these issues. Therefore, this study conducts a meta-review to explore data issues and methods within the implementation of industrial AI. Seventy-two data issues are identified and categorized into various stages of the data lifecycle, including data source and collection, data access and storage, data integration and interoperation, data pre-processing, data processing, data security and privacy, and AI technology adoption. Subsequently, the study analyzes the data requirements of various AI algorithms. Building on the aforementioned analyses, it proposes a data management framework, addressing how data issues can be systematically resolved at every stage of the data lifecycle. Finally, the study highlights future research directions. In doing so, this study enriches the existing body of knowledge and provides guidelines for professionals navigating the complex landscape of achieving data usability and usefulness in industrial AI.


title: Anomolous rheology of puller-type microswimmer suspensions

abstract: We explore the mechanism behind the anomalous rheology of puller-type microswimmer suspensions through direct hydrodynamic simulations. Our simulations demonstrate that swimmers' orientations near boundary walls predominantly control the overall swimming states and the resultant rheological properties. Hydrodynamic interactions due to specific flow fields characteristic of pullers cause the swimmers to line up vertically, particularly close to the walls where swimmer density peaks, enhancing the polar order of collective motion. Furthermore, the swimming directions near the walls depend significantly on the aspect ratio of the swimmer's body: rod-like swimmers tend to swim toward the flow direction, while swimmers with spherical bodies swim against the flow direction. The present results contrast with our previous simulations of suspensions of pusher-type swimmers, where weak orientation order in bulk regions determines the steady-state properties. Furthermore, these findings highlight that the rheological properties of active suspensions vary widely depending on the swimmers' properties, such as their shapes and swimming mechanisms.


title: What Matters in Transformers? Not All Attention is Needed

abstract: Scaling Transformer-based large language models (LLMs) has demonstrated promising performance across various tasks. However, this scaling also introduces redundant structures, posing challenges for real-world deployment. Despite some recognition of redundancy in LLMs, the variability of redundancy across different structures, such as MLP and Attention layers, is under-explored. In this work, we investigate the varying redundancy across different modules within Transformers, including Blocks, MLP, and Attention layers, using a similarity-based metric. This metric operates on the premise that redundant structures produce outputs highly similar to their inputs. Surprisingly, while attention layers are essential for transformers and distinguish them from other mainstream architectures, we found that a large proportion of attention layers exhibit excessively high similarity and can be safely pruned without degrading performance, leading to reduced memory and computation costs. Additionally, we further propose a method that jointly drops Attention and MLP layers, achieving improved performance and dropping ratios. Extensive experiments demonstrate the effectiveness of our methods, e.g., Llama-3-70B maintains comparable performance even after pruning half of the attention layers. Our findings provide valuable insights for future network architecture design. The code will be released at: \url{https://github.com/Shwai-He/LLM-Drop}.


title: On Physics-Informed Neural Network Control for Power Electronics

abstract: Considering the growing necessity for precise modeling of power electronics amidst operational and environmental uncertainties, this paper introduces an innovative methodology that ingeniously combines model-driven and data-driven approaches to enhance the stability of power electronics interacting with grid-forming microgrids. By employing the physics-informed neural network (PINN) as a foundation, this strategy merges robust data-fitting capabilities with fundamental physical principles, thereby constructing an accurate system model. By this means, it significantly enhances the ability to understand and replicate the dynamics of power electronics systems under complex working conditions. Moreover, by incorporating advanced learning-based control methods, the proposed method is enabled to make precise predictions and implement the satisfactory control laws even under serious uncertain conditions. Experimental validation demonstrates the effectiveness and robustness of the proposed approach, highlighting its substantial potential in addressing prevalent uncertainties in controlling modern power electronics systems.


title: Distributionally Robust Constrained Reinforcement Learning under Strong Duality

abstract: We study the problem of Distributionally Robust Constrained RL (DRC-RL), where the goal is to maximize the expected reward subject to environmental distribution shifts and constraints. This setting captures situations where training and testing environments differ, and policies must satisfy constraints motivated by safety or limited budgets. Despite significant progress toward algorithm design for the separate problems of distributionally robust RL and constrained RL, there do not yet exist algorithms with end-to-end convergence guarantees for DRC-RL. We develop an algorithmic framework based on strong duality that enables the first efficient and provable solution in a class of environmental uncertainties. Further, our framework exposes an inherent structure of DRC-RL that arises from the combination of distributional robustness and constraints, which prevents a popular class of iterative methods from tractably solving DRC-RL, despite such frameworks being applicable for each of distributionally robust RL and constrained RL individually. Finally, we conduct experiments on a car racing benchmark to evaluate the effectiveness of the proposed algorithm.


title: Privacy Implications of Explainable AI in Data-Driven Systems

abstract: Machine learning (ML) models, demonstrably powerful, suffer from a lack of interpretability. The absence of transparency, often referred to as the black box nature of ML models, undermines trust and urges the need for efforts to enhance their explainability. Explainable AI (XAI) techniques address this challenge by providing frameworks and methods to explain the internal decision-making processes of these complex models. Techniques like Counterfactual Explanations (CF) and Feature Importance play a crucial role in achieving this goal. Furthermore, high-quality and diverse data remains the foundational element for robust and trustworthy ML applications. In many applications, the data used to train ML and XAI explainers contain sensitive information. In this context, numerous privacy-preserving techniques can be employed to safeguard sensitive information in the data, such as differential privacy. Subsequently, a conflict between XAI and privacy solutions emerges due to their opposing goals. Since XAI techniques provide reasoning for the model behavior, they reveal information relative to ML models, such as their decision boundaries, the values of features, or the gradients of deep learning models when explanations are exposed to a third entity. Attackers can initiate privacy breaching attacks using these explanations, to perform model extraction, inference, and membership attacks. This dilemma underscores the challenge of finding the right equilibrium between understanding ML decision-making and safeguarding privacy.


title: Two-Field Quintessential Higgs model and the Swampland

abstract: We study a two-field model where a quintessence field with an exponential potential $e^{-\beta\phi/M_P}$ is coupled to the Higgs field. It is claimed that this model is consistent with the proposed Swampland conjecture. We check this claim by calculating its inflationary observables. Although, these observables are in good agreement with the latest CMB data, but we find an upper bound $\beta \lesssim 8\times 10^{-3}$ that strongly disfavors the Swampland conjecture.


title: Wireless MapReduce Arrays for Coded Distributed Computing

abstract: We consider a wireless distributed computing system based on the MapReduce framework, which consists of three phases: \textit{Map}, \textit{Shuffle}, and \textit{Reduce}. The system consists of a set of distributed nodes assigned to compute arbitrary output functions depending on a file library. The computation of the output functions is decomposed into Map and Reduce functions, and the Shuffle phase, which involves the data exchange, links the two. In our model, the Shuffle phase communication happens over a full-duplex wireless interference channel. For this setting, a coded wireless MapReduce distributed computing scheme exists in the literature, achieving optimal performance under one-shot linear schemes. However, the scheme requires the number of input files to be very large, growing exponentially with the number of nodes. We present schemes that require the number of files to be in the order of the number of nodes and achieve the same performance as the existing scheme. The schemes are obtained by designing a structure called wireless MapReduce array that succinctly represents all three phases in a single array. The wireless MapReduce arrays can also be obtained from the extended placement delivery arrays known for multi-antenna coded caching schemes.


title: Weighted Hardy-Rellich type inequalities: improved best constants and symmetry breaking

abstract: When studying the weighted Hardy-Rellich inequality in $L^2$ with the full gradient replaced by the radial derivative the best constant becomes trivially larger or equal than in the first situation. Our contribution is to determine the new sharp constant and to show that for some part of the weights is strictly larger than before. In some cases we emphasize that the extremals functions of the sharp constant are not radially symmetric.


title: Complexity of Adagrad and other first-order methods for nonconvex optimization problems with bounds and convex constraints

abstract: A parametric class of trust-region algorithms for constrained nonconvex optimization is analyzed, where the objective function is never computed. By defining appropriate first-order stationarity criteria, we are able to extend the Adagrad method to the newly considered problem and retrieve the standard complexity rate of the projected gradient method that uses both the gradient and objective function values. Furthermore, we propose an additional iteration-dependent scaling with slightly inferior theoretical guarantees. In both cases, the bounds are essentially sharp, and curvature information can be used to compute the stepsize. The adaptation of the algorithm to the convex constrained case is discussed, and initial experimental results for noisy bound-constrained instances illustrate the benefits of the objective-free approach.


title: Linear complementary pairs of codes over a finite non-commutative Frobenius ring

abstract: In this paper, we study linear complementary pairs (LCP) of codes over finite non-commutative local rings. We further provide a necessary and sufficient condition for a pair of codes $(C,D)$ to be LCP of codes over finite non-commutative Frobenius rings. The minimum distances $d(C)$ and $d(D^\perp)$ are defined as the security parameter for an LCP of codes $(C, D).$ It was recently demonstrated that if $C$ and $D$ are both $2$-sided LCP of group codes over a finite commutative Frobenius rings, $D^\perp$ and $C$ are permutation equivalent in \cite{LL23}. As a result, the security parameter for a $2$-sided group LCP $(C, D)$ of codes is simply $d(C)$. Towards this, we deliver an elementary proof of the fact that for a linear complementary pair of codes $(C,D)$, where $C$ and $D$ are linear codes over finite non-commutative Frobenius rings, under certain conditions, the dual code $D^\perp$ is equivalent to $C.$


title: Risk-Dominant Equilibrium in Quantum Prisoner's Dilemma

abstract: The choice of a unique Nash equilibrium (NE) is crucial in theoretical classical and quantum games. The Eiswer-Wilkens-Lewenstein quantization scheme solves the prisoner's dilemma only for high entanglement. At medium entanglement, there are multiple NEs. We investigate the selection of a unique NE in the quantum prisoner's dilemma with variable dilemma strength parameters. The risk-dominance criterion is used. The influence of the dilemma strength parameters and entanglement is emphasized. We found that entanglement completely controls the risk-dominant equilibrium. Entanglement promotes quantum-cooperation in the risk-dominant equilibrium and thus improves its outcome.


title: Rethinking Entity-level Unlearning for Large Language Models

abstract: Large language model unlearning has gained increasing attention due to its potential to mitigate security and privacy concerns. Current research predominantly focuses on Instance-level unlearning, specifically aiming at forgetting predefined instances of sensitive content. However, a notable gap still exists in exploring the deletion of complete entity-related information, which is crucial in many real-world scenarios, such as copyright protection. To this end, we propose a novel task of Entity-level unlearning, where the entity-related knowledge within the target model is supposed to be entirely erased. Given the challenge of practically accessing all entity-related knowledge within a model, we begin by simulating entity-level unlearning scenarios through fine-tuning models to introduce pseudo entities. Following this, we develop baseline methods inspired by trending unlearning techniques and conduct a detailed comparison of their effectiveness in this task. Extensive experiments reveal that current unlearning algorithms struggle to achieve effective entity-level unlearning. Additionally, our analyses further indicate that entity-related knowledge injected through fine-tuning is more susceptible than original entities from pre-training during unlearning, highlighting the necessity for more thorough pseudo-entity injection methods to make them closer to pre-trained knowledge.


abstract: Employing graph neural networks (GNNs) to learn cohesive and discriminative node representations for clustering has shown promising results in deep graph clustering. However, existing methods disregard the reciprocal relationship between representation learning and structure augmentation. This study suggests that enhancing embedding and structure synergistically becomes imperative for GNNs to unleash their potential in deep graph clustering. A reliable structure promotes obtaining more cohesive node representations, while high-quality node representations can guide the augmentation of the structure, enhancing structural reliability in return. Moreover, the generalization ability of existing GNNs-based models is relatively poor. While they perform well on graphs with high homogeneity, they perform poorly on graphs with low homogeneity. To this end, we propose a graph clustering framework named Synergistic Deep Graph Clustering Network (SynC). In our approach, we design a Transform Input Graph Auto-Encoder (TIGAE) to obtain high-quality embeddings for guiding structure augmentation. Then, we re-capture neighborhood representations on the augmented graph to obtain clustering-friendly embeddings and conduct self-supervised clustering. Notably, representation learning and structure augmentation share weights, significantly reducing the number of model parameters. Additionally, we introduce a structure fine-tuning strategy to improve the model's generalization. Extensive experiments on benchmark datasets demonstrate the superiority and effectiveness of our method. The code is released on GitHub and Code Ocean.


title: High order discontinuous Galerkin schemes with subcell finite volume limiter and AMR for a monolithic first--order BSSNOK formulation of the Einstein--Euler equations

abstract: We propose a high order discontinuous Galerkin (DG) scheme with subcell finite volume (FV) limiter to solve a monolithic first--order hyperbolic BSSNOK formulation of the coupled Einstein--Euler equations. The numerical scheme runs with adaptive mesh refinement (AMR) in three space dimensions, is endowed with time-accurate local time stepping (LTS) and is able to deal with both conservative and non-conservative hyperbolic systems. The system of governing partial differential equations was shown to be strongly hyperbolic and is solved in a monolithic fashion with one numerical framework that can be simultaneously applied to both the conservative matter subsystem as well as the non-conservative subsystem for the spacetime. Since high order unlimited DG schemes are well-known to produce spurious oscillations in the presence of discontinuities and singularities, our subcell finite volume limiter is crucial for the robust discretization of shock waves arising in the matter as well as for the stable treatment of puncture black holes. We test the new method on a set of classical test problems of numerical general relativity, showing good agreement with available exact or numerical reference solutions. In particular, we perform the first long term evolution of the inspiralling merger of two puncture black holes with a high order ADER-DG scheme.


title: Surface phonons and possible structural phase transition in a topological semimetal PbTaSe2

abstract: Topological insulators are a novel class of quantum materials characterized by protected gapless surface or edge states but insulating bulk states which is due to presence of spin-orbit interactions and time-reversal symmetry. Such an intriguing surface and bulk topology manifests itself in coupling with lattice dynamics due to electron-phonon scattering. Here we report an in-depth investigation of a topological nodal line semimetal PbTaSe2 via temperature, polarization dependent Raman spectroscopy and temperature dependent single crystal X-ray diffraction (SC-XRD) measurements. Our analysis shows signature of electron-phonon coupling as reflected in the Fano asymmetry in line shape of M1-M4 modes and anomalous temperature variation of line-width of P3-P4 modes. Further polarization dependent phonon symmetry changes at different temperature (6K and 300K), discontinuities in bulk phonon dynamics for P2-P5 modes and disappearance of phonon modes i.e., M1-M5, on decreasing temperatures indicates towards a thermally induced structural phase transition which is also supported by the SC-XRD results. Hence based on our findings we propose that M1-M4 modes are surface phonon modes, the material undergoes a thermally induced structural phase transition from alpha to beta phase at T ~ 150 K or is in close proximity to the beta phase and another transition below T(CDW+beta) ~ 100K which is possibly due to the interplay of remanent completely commensurate charge density wave (CCDW) of 1H-TaSe2 and beta phase.


title: Classification of the types for which every Hopf--Galois correspondence is bijective

abstract: Let $L/K$ be any finite Galois extension with Galois group $G$. It is known by Chase and Sweedler that the Hopf--Galois correspondence is injective for every Hopf--Galois structure on $L/K$, but it need not be bijective in general. Hopf--Galois structures are known to be related to skew braces, and recently, the first-named author and Trappeniers proposed a new version of this connection with the property that the intermediate fields of $L/K$ in the image of the Hopf--Galois correspondence are in bijection with the left ideals of the associated skew brace. As an application, they classified the groups $G$ for which the Hopf--Galois correspondence is bijective for every Hopf--Galois structure on any $G$-Galois extension. In this paper, using a similar approach, we shall classify the groups $N$ for which the Hopf--Galois correspondence is bijective for every Hopf--Galois structure of type $N$ on any Galois extension.


title: Limit theorems for Gaussian fields via Chaos Expansions and Applications

abstract: In this PhD thesis, we apply a combination of Malliavin calculus and Stein's method in the framework of probability approximations. The specific problems we tackle with these methods are motivated by probabilistic models in cosmology (Part I: Quantitative CLTs for non linear functionals of random hyperspherical harmonics) and finance (Part II: The fractional Ornstein-Uhlenbeck process in rough volatility modelling). In this second part we also apply techniques from Large Deviations theory (Section: Short-time asymptotics for non self-similar stochastic volatility models).


title: Coded Beam Training for RIS Assisted Wireless Communications

abstract: Reconfigurable intelligent surface (RIS) is considered as one of the key technologies for future 6G communications. To fully unleash the performance of RIS, accurate channel state information (CSI) is crucial. Beam training is widely utilized to acquire the CSI. However, before aligning the beam correctly to establish stable connections, the signal-to-noise ratio (SNR) at UE is inevitably low, which reduces the beam training accuracy. To deal with this problem, we exploit the coded beam training framework for RIS systems, which leverages the error correction capability of channel coding to improve the beam training accuracy under low SNR. Specifically, we first extend the coded beam training framework to RIS systems by decoupling the base station-RIS channel and the RIS-user channel. For this framework, codewords that accurately steer to multiple angles is essential for fully unleashing the error correction capability. In order to realize effective codeword design in RIS systems, we then propose a new codeword design criterion, based on which we propose a relaxed Gerchberg-Saxton (GS) based codeword design scheme by considering the constant modulus constraints of RIS elements. In addition, considering the two dimensional structure of RIS, we further propose a dimension reduced encoder design scheme, which can not only guarentee a better beam shape, but also enable a stronger error correction capability. Simulation results reveal that the proposed scheme can realize effective and accurate beam training in low SNR scenarios.


title: Root polytopes, flow polytopes, and order polytopes

abstract: In this paper we study the class of polytopes which can be obtained by taking the convex hull of some subset of the points $\{e_i-e_j \ \vert \ i \neq j\} \cup \{\pm e_i\}$ in $\mathbb{R}^n$, where $e_1,\dots,e_n$ is the standard basis of $\mathbb{R}^n$. Such a polytope can be encoded by a quiver $Q$ with vertices $V \subseteq \{v_1,\dots,v_n\} \cup \{\star\}$, where each edge $v_j\to v_i$ or $\star \to v_i$ or $v_i\to \star$ gives rise to the point $e_i-e_j$ or $e_i$ or $-e_i$, respectively; we denote the corresponding polytope as $\operatorname{Root}(Q)$. These polytopes have been studied extensively under names such as edge polytope and root polytope. We show that if the quiver $Q$ is star-connected (or strongly-connected if there is no $\star$ vertex) then the root polytope $\operatorname{Root}(Q)$ is reflexive and terminal; we moreover give a combinatorial description of the facets of $\operatorname{Root}(Q)$. We also show that if $Q$ is planar, then $\operatorname{Root}(Q)$ is (integrally equivalent to the) polar dual of the flow polytope of the dual quiver $Q^{\vee}$. Finally we consider the case that $Q$ comes from the Hasse diagram of a ranked poset $P$, and show that $\operatorname{Root}(Q)$ is polar dual to (a translation of) a marked poset polytope. Additionally, we show that the face fan $\mathcal{F}_Q$ of $\operatorname{Root}(Q)$ refines the normal fan $\mathcal{N}(\mathcal{O}(P))$ of the order polytope $\mathcal{O}(P)$, and when $P$ is graded, these fans coincide. We moreover give a combinatorial description of the Picard group of the toric variety associated to $\mathcal{F}_Q$ for any ranked poset $P$, in terms of a new ``canonical extension'' of $P$. These results have applications to mirror symmetry.


title: Split Federated Learning Empowered Vehicular Edge Intelligence: Adaptive Parellel Design and Future Directions

abstract: To realize ubiquitous intelligence of future vehicular networks, artificial intelligence (AI) is critical since it can mine knowledge from vehicular data to improve the quality of many AI driven vehicular services. By combining AI techniques with vehicular networks, Vehicular Edge Intelligence (VEI) can utilize the computing, storage, and communication resources of vehicles to train the AI models. Nevertheless, when executing the model training, the traditional centralized learning paradigm requires vehicles to upload their raw data to a central server, which results in significant communication overheads and the risk of privacy leakage. In this article, we first overview the system architectures, performance metrics and challenges ahead of VEI design. Then we propose to utilize distribute machine learning scheme, namely split federated learning (SFL), to boost the development of VEI. We present a novel adaptive and parellel SFL scheme and conduct corresponding analysis on its performance. Future research directions are highlighted to shed light on the efficient design of SFL.


title: Smart Feature is What You Need

abstract: Lack of shape guidance and label jitter caused by information deficiency of weak label are the main problems in 3D weakly-supervised object detection. Current weakly-supervised models often use heuristics or assumptions methods to infer information from weak labels without taking advantage of the inherent clues of weakly-supervised and fully-supervised methods, thus it is difficult to explore a method that combines data utilization efficiency and model accuracy. In an attempt to address these issues, we propose a novel plug-and-in point cloud feature representation network called Multi-scale Mixed Attention (MMA). MMA utilizes adjacency attention within neighborhoods and disparity attention at different density scales to build a feature representation network. The smart feature representation obtained from MMA has shape tendency and object existence area inference, which can constrain the region of the detection boxes, thereby alleviating the problems caused by the information default of weak labels. Extensive experiments show that in indoor weak label scenarios, the fully-supervised network can perform close to that of the weakly-supervised network merely through the improvement of point feature by MMA. At the same time, MMA can turn waste into treasure, reversing the label jitter problem that originally interfered with weakly-supervised detection into the source of data enhancement, strengthening the performance of existing weak supervision detection methods. Our code is available at https://github.com/hzx-9894/MMA.


title: Robust Dynamic Control Barrier Function Based Trajectory Planning for Mobile Manipulator

abstract: High-dimensional robot dynamic trajectory planning poses many challenges for traditional planning algorithms. Existing planning methods suffer from issues such as long computation times, limited capacity to address intricate obstacle models, and lack of consideration for external disturbances and measurement inaccuracies in these high-dimensional systems. To tackle these challenges, this paper proposes a novel trajectory planning approach that combines Dynamic Control Barrier Function (DCBF) with a disturbance observer to create a Robust Dynamic Control Barrier Function (RDCBF) planner. This approach successfully plans trajectories in environments with complex dynamic obstacles while accounting for external disturbances and measurement uncertainties, ensuring system safety and enabling precise obstacle avoidance. Experimental results on a mobile manipulator demonstrate outstanding performance of the proposed approach.


title: Low-Voltage Electron Emission by Graphene-hBN-graphene Heterostructure

abstract: Scanning Electron Microscopes (SEM) with low energy electron sources (accelerating voltage of less than 1000V) have important application requirements in many application scenarios. Tunneling junction can potentially achieve low-voltage and planar-type electron sources with good emission current density. However, further lower the extracting voltage while ensure the emission current density remains challenging. In this paper, we report a low-voltage planar-type electron source based on graphene-hBN-graphene heterostructures (GBGH) under a really low out-plane extracting voltage. The external electric field strength applied to the electron sources is only 4 times 10^4V/m and the accelerating voltage as low as 20V is realized. Steady electron emission of over 1nA and operating duration of several hours is observed from the GBGH with size of 59.29um^2 in our experiments, and thus the maximum emission current density reaches 7mA/cm^2. Great electrical contacts, extremely low thickness, and excellent layer properties of two-dimensional (2D) materials lead to easy-fabrication and miniature on-chip electron sources, which would significantly contribute to the development of next-generation free electron devices.


title: Understanding Student and Academic Staff Perceptions of AI Use in Assessment and Feedback

abstract: The rise of Artificial Intelligence (AI) and Generative Artificial Intelligence (GenAI) in higher education necessitates assessment reform. This study addresses a critical gap by exploring student and academic staff experiences with AI and GenAI tools, focusing on their familiarity and comfort with current and potential future applications in learning and assessment. An online survey collected data from 35 academic staff and 282 students across two universities in Vietnam and one in Singapore, examining GenAI familiarity, perceptions of its use in assessment marking and feedback, knowledge checking and participation, and experiences of GenAI text detection. Descriptive statistics and reflexive thematic analysis revealed a generally low familiarity with GenAI among both groups. GenAI feedback was viewed negatively; however, it was viewed more positively when combined with instructor feedback. Academic staff were more accepting of GenAI text detection tools and grade adjustments based on detection results compared to students. Qualitative analysis identified three themes: unclear understanding of text detection tools, variability in experiences with GenAI detectors, and mixed feelings about GenAI's future impact on educational assessment. These findings have major implications regarding the development of policies and practices for GenAI-enabled assessment and feedback in higher education.


title: LaMSUM: A Novel Framework for Extractive Summarization of User Generated Content using LLMs

abstract: Large Language Models (LLMs) have demonstrated impressive performance across a wide range of NLP tasks, including summarization. Inherently LLMs produce abstractive summaries, and the task of achieving extractive summaries through LLMs still remains largely unexplored. To bridge this gap, in this work, we propose a novel framework LaMSUM to generate extractive summaries through LLMs for large user-generated text by leveraging voting algorithms. Our evaluation on three popular open-source LLMs (Llama 3, Mixtral and Gemini) reveal that the LaMSUM outperforms state-of-the-art extractive summarization methods. We further attempt to provide the rationale behind the output summary produced by LLMs. Overall, this is one of the early attempts to achieve extractive summarization for large user-generated text by utilizing LLMs, and likely to generate further interest in the community.


title: Evaluating Joule heating influence on heat transfer and entropy generation in MHD channel flow: A parametric study and ill-posed problem solution using PINNs

abstract: In this study the effects of Joule heating parameter on entropy generation and heat transfer in MHD flow inside a channel is investigated by means of Physics-Informed Neural Networks (PINNs) in form of a parametric analysis in addition to exploring the solution to the ill-posed problem. All of the governing equations are reformulated in terms of first order derivatives and the dimensionless form of the governing equations has been employed to further lessen the number of parameters and achieve better compatibility with loss function terms. Dimensionless groups such as Reynolds number, Prandtl number, Hartmann number and Joule heating parameter have been designated as the input for the neural network in order to perform the parametric study. Besides achieving high accuracy for case of parameters confined in the predefined ranges, the generalization ability of the method is depicted by solving the problem for the cases where the dimensionless parameters were outside of the assumed ranges. Moreover, the ability of handling Neumann boundary conditions is also investigated in the present study despite being neglected prevalently in the literature concerning PINNs. The effects of Joule heating parameter on entropy generation are researched using a parametric approach utilizing PINNs which is another novel aspect of the article at hand. As a concluding remark, an ill-posed problem is also defined such that the Joule heating parameter is included in a learning process and the method has been able to determine Joule heating parameter as a parameter of interest alongside other learnable parameters of the neural network such as weights and biases.


title: PointDreamer: Zero-shot 3D Textured Mesh Reconstruction from Colored Point Cloud by 2D Inpainting

abstract: Reconstructing textured meshes from colored point clouds is an important but challenging task in 3D graphics and vision. Most existing methods predict colors as implicit functions in 3D or UV space, suffering from blurry textures or the lack of generalization capability. Addressing this, we propose PointDreamer, a novel framework for textured mesh reconstruction from colored point cloud. It produces meshes with enhanced fidelity and clarity by 2D image inpainting, taking advantage of the mature techniques and massive data of 2D vision. Specifically, we first project the input point cloud into 2D space to generate sparse multi-view images, and then inpaint empty pixels utilizing a pre-trained 2D diffusion model. Next, we design a novel Non-Border-First strategy to unproject the colors of the inpainted dense images back to 3D space, thus obtaining the final textured mesh. In this way, our PointDreamer works in a zero-shot manner, requiring no extra training. Extensive qualitative and quantitative experiments on various synthetic and real-scanned datasets show the SoTA performance of PointDreamer, by significantly outperforming baseline methods with 30\% improvement in LPIPS score (from 0.118 to 0.068). Code at: https://github.com/YuQiao0303/PointDreamer.


title: Intrinsic Dimension Correlation: uncovering nonlinear connections in multimodal representations

abstract: To gain insight into the mechanisms behind machine learning methods, it is crucial to establish connections among the features describing data points. However, these correlations often exhibit a high-dimensional and strongly nonlinear nature, which makes them challenging to detect using standard methods. This paper exploits the entanglement between intrinsic dimensionality and correlation to propose a metric that quantifies the (potentially nonlinear) correlation between high-dimensional manifolds. We first validate our method on synthetic data in controlled environments, showcasing its advantages and drawbacks compared to existing techniques. Subsequently, we extend our analysis to large-scale applications in neural network representations. Specifically, we focus on latent representations of multimodal data, uncovering clear correlations between paired visual and textual embeddings, whereas existing methods struggle significantly in detecting similarity. Our results indicate the presence of highly nonlinear correlation patterns between latent manifolds.


title: Extraction of binary neutron star gravitational wave waveforms from Einstein Telescope using deep learning

abstract: In the future, the third generation (3G) gravitational wave (GW) detectors, exemplified by the Einstein Telescope (ET), will be operational. The detection rate of GW from binary neutron star (BNS) is expected to reach approximately $10^4$ per year. To address the challenges posed by BNS GW data processing for 3G GW detectors, this paper explores the extraction of BNS waveforms from ET. Drawing inspiration from SPIIR's matched filtering approach, we introduce a novel framework leveraging deep learning for BNS waveform extraction. By integrating denoised outputs of time-delayed strain, we can reconstruct the embedded BNS waveform. We have established three distinct BNS GW denoising models, each tailored to address the early inspiral, later inspiral, and merger phases of BNS GW, respectively. To further regulate the waveform shape, we propose the Amplitude Regularity Model that takes denoised output as input and regulated waveform as output. The experiments conducted on test data demonstrate the efficacy of the denoising models, the Amplitude Regularity Models, as well as the overall waveform construction method. To the best of our knowledge, this marks the first instance of deep learning being utilized for the task of BNS waveform extraction. We believe that the proposed method holds promise for early warning, searching, and localization of BNS GWs.


title: Simulation-Optimization Approaches for the Network Immunization Problem with Quarantining

abstract: Vaccination has played an important role in preventing the spread of infectious diseases. However, the limited availability of vaccines and personnel at the roll-out of a new vaccine, as well as the costs of vaccination campaigns, might limit how many people can be vaccinated. Network immunization thus focuses on selecting a fixed-size subset of individuals to vaccinate so as to minimize the disease spread. In this paper, we consider simulation-optimization approaches for this selection problem. Here, the simulation of disease spread in an activity-based contact graph allows us to consider the effect of contact tracing and a limited willingness to test and quarantine. First, we develop a stochastic programming algorithm based on sampling infection forests from the simulation. Second, we propose a genetic algorithm that is tailored to the immunization problem and combines simulation runs of different sizes to balance the time needed to find promising solutions with the uncertainty resulting from simulation. Both approaches are tested on data from a major university in Denmark and disease characteristics representing those of COVID-19. Our results show that the proposed methods are competitive with a large number of centrality-based measures over a range of disease parameters and that the proposed methods are able to outperform them for a considerable number of these instances. Finally, we compare network immunization against our previously proposed approach of limiting distinct contacts. Although, independently, network immunization has a larger impact in reducing disease spread, we show that the combination of both methods reduces the disease spread even further.


title: On the null space of the backprojection operator and Rubin's conjecture for the spherical mean transform

abstract: The spherical mean transform associates to a function $f$ its integral averages over all spheres. We consider the spherical mean transform for functions supported in the unit ball $\mathbb{B}$ in $\mathbb{R}^n$ for odd $n$, with the centers of integration spheres restricted to the unit sphere $\mathbb{S}^{n-1}$. In this setup, Rubin employed properties of Erd\'elyi-Kober fractional integrals and analytic continuation to re-derive the explicit inversion formulas proved earlier by Finch, Patch, and Rakesh using wave equation techniques. As part of his work, Rubin stated a conjecture relating spherical mean transform, its associated backprojection operator and the Riesz potential. Furthermore, he pointed to the necessity of a detailed analysis of injectivity of the backprojection operator as a crucial step toward the resolution of his conjecture. This article addresses both questions posed by Rubin by providing a characterization of the null space of the backprojection operator, and disproving the conjecture through the construction of an explicit counterexample. Crucial to the proofs is the range characterization for the spherical mean transform in odd dimensions derived recently by the authors.


title: Reading Is Believing: Revisiting Language Bottleneck Models for Image Classification

abstract: We revisit language bottleneck models as an approach to ensuring the explainability of deep learning models for image classification. Because of inevitable information loss incurred in the step of converting images into language, the accuracy of language bottleneck models is considered to be inferior to that of standard black-box models. Recent image captioners based on large-scale foundation models of Vision and Language, however, have the ability to accurately describe images in verbal detail to a degree that was previously believed to not be realistically possible. In a task of disaster image classification, we experimentally show that a language bottleneck model that combines a modern image captioner with a pre-trained language model can achieve image classification accuracy that exceeds that of black-box models. We also demonstrate that a language bottleneck model and a black-box model may be thought to extract different features from images and that fusing the two can create a synergistic effect, resulting in even higher classification accuracy.


title: Computable one-way functions on the reals

abstract: A major open problem in computational complexity is the existence of a one-way function, namely a function from strings to strings which is computationally easy to compute but hard to invert. Levin (2023) formulated the notion of one-way functions from reals (infinite bit-sequences) to reals in terms of computability, and asked whether partial computable one-way functions exist. We give a strong positive answer using the hardness of the halting problem and exhibiting a total computable one-way function.


title: Meso-inflationary Peccei-Quinn symmetry breaking with non-minimal coupling

abstract: We study a realization of the inflationary scenario where the Peccei-Quinn (PQ) symmetry is spontaneously broken during inflation, facilitated by its non-minimal coupling to gravity. This results in effectively two-field inflation: the early stage is driven by an inflaton field with the PQ symmetry intact, and the later stage is driven by the PQ scalar after its effective mass becomes tachyonic, causing destabilization from the origin. The non-minimal coupling serves the dual purpose of restoring the PQ symmetry during early inflation and flattening the PQ potential post-tachyonic shift, allowing for continued slow roll. We analyze the inflationary background solutions and scalar perturbations, which are amplified at small scales via significant isocurvature perturbations generated near the symmetry-breaking epoch. These perturbations lead to second-order gravitational waves, detectable by next-generation space-based experiments.


title: Automatic AI Model Selection for Wireless Systems: Online Learning via Digital Twinning

abstract: In modern wireless network architectures, such as O-RAN, artificial intelligence (AI)-based applications are deployed at intelligent controllers to carry out functionalities like scheduling or power control. The AI "apps" are selected on the basis of contextual information such as network conditions, topology, traffic statistics, and design goals. The mapping between context and AI model parameters is ideally done in a zero-shot fashion via an automatic model selection (AMS) mapping that leverages only contextual information without requiring any current data. This paper introduces a general methodology for the online optimization of AMS mappings. Optimizing an AMS mapping is challenging, as it requires exposure to data collected from many different contexts. Therefore, if carried out online, this initial optimization phase would be extremely time consuming. A possible solution is to leverage a digital twin of the physical system to generate synthetic data from multiple simulated contexts. However, given that the simulator at the digital twin is imperfect, a direct use of simulated data for the optimization of the AMS mapping would yield poor performance when tested in the real system. This paper proposes a novel method for the online optimization of AMS mapping that corrects for the bias of the simulator by means of limited real data collected from the physical system. Experimental results for a graph neural network-based power control app demonstrate the significant advantages of the proposed approach.


title: On the `mosaic' picture of liquids and glasses

abstract: Supercooled liquids are sometimes described as being composed of a mosaic of patches that may be listed in a `library', each one having some form of non-periodic order. Looking closer, one finds this construction elusive. In attempting to give the notion of mosaic a precise sense, we find that we are inevitably led to the construction of a procedure for compressing the information in the particle configuration, essentially the same as that used for texts. The amount of optimally stored information directly defines the configurational entropy. A solid, in this view, is a particle arrangement described by a low amount of information, that can only flow by breaking into uncorrelated pieces, thus increasing its complexity.


title: A general frame of quantum simulation for nonlinear partial differential equations

abstract: Currently, Jin et al. proposed a quantum simulation technique for any a linear PDE, called Schr\"{o}dingerisation [1-3], which has been successfully applied to solve many non-Hamiltonian linear PDEs. In this paper, the Schr\"{o}dingerisation technique of quantum simulation is expanded to any a nonlinear PDE by means of combining the Schr\"{o}dingerisation technique with the homotopy analysis method (HAM) [4-6] that can transfer any a nonlinear PDE into a series of linear PDEs with convergence guarantee of series solution. In this way, a nonlinear PDE can be solved by quantum simulation using a quantum computer -- yet to be developed in the future. For simplicity, we call it ``the HAM-Schr\"{o}dingerisation quantum algorithm''.


title: On the Weisfeiler-Leman dimension of circulant graphs

abstract: A circulant graph is a Cayley graph of a finite cyclic group. The Weisfeiler-Leman-dimension of a circulant graph $X$ with respect to the class of all circulant graphs is the smallest positive integer~$m$ such that the $m$-dimensional Weisfeiler-Leman algorithm correctly tests the isomorphism between $X$ and any other circulant graph. It is proved that for a circulant graph of order $n$ this dimension is less than or equal to $\Omega(n)+3$, where $\Omega(n)$ is the number of prime divisors of~$n$.


title: CaT-BENCH: Benchmarking Language Model Understanding of Causal and Temporal Dependencies in Plans

abstract: Understanding the abilities of LLMs to reason about natural language plans, such as instructional text and recipes, is critical to reliably using them in decision-making systems. A fundamental aspect of plans is the temporal order in which their steps needs to be executed, which reflects the underlying causal dependencies between them. We introduce CaT-Bench, a benchmark of Step Order Prediction questions, which test whether a step must necessarily occur before or after another in cooking recipe plans. We use this to evaluate how well frontier LLMs understand causal and temporal dependencies. We find that SOTA LLMs are underwhelming (best zero-shot is only 0.59 in F1), and are biased towards predicting dependence more often, perhaps relying on temporal order of steps as a heuristic. While prompting for explanations and using few-shot examples improve performance, the best F1 result is only 0.73. Further, human evaluation of explanations along with answer correctness show that, on average, humans do not agree with model reasoning. Surprisingly, we also find that explaining after answering leads to better performance than normal chain-of-thought prompting, and LLM answers are not consistent across questions about the same step pairs. Overall, results show that LLMs' ability to detect dependence between steps has significant room for improvement.


title: Non-Expanding Random walks on Homogeneous spaces and Diophantine approximation

abstract: We study non-expanding random walks on the space of affine lattices and establish a new classification theorem for stationary measures. Further, we prove a theorem that relates the genericity with respect to these random walks to Birkhoff genericity. Finally, we apply these theorems to obtain several results in inhomogeneous Diophantine approximation, especially on fractals.


title: Bifurcation results and multiple solutions for the fractional $(p,q)$-Laplace operators

abstract: We investigate a nonlinear nonlocal eigenvalue problem involving the sum of fractional $(p,q)$-Laplace operators $(-\Delta)_p^{s_1}+(-\Delta)_q^{s_2}$ with $s_1,s_2\in (0,1)$; $p,q\in(1,\infty)$ and subject to Dirichlet boundary conditions in an open bounded set of $\mathbb{R}^N$. We prove bifurcation results from trivial solutions and from infinity for the considered nonlinear nonlocal eigenvalue problem. We also show the existence of multiple solutions of the nonlinear nonlocal problem using variational methods.


title: Recurrence in collective dynamics: From the hyperspace to fuzzy dynamical systems

abstract: We study for a dynamical system $f:X\longrightarrow X$ some of the principal topological recurrence-kind properties with respect to the induced maps $\overline{f}:\mathcal{K}(X)\longrightarrow\mathcal{K}(X)$, on the hyperspace of non-empty compact subsets of $X$, and $\hat{f}:\mathcal{F}(X)\longrightarrow\mathcal{F}(X)$, on the space of normal fuzzy sets consisting of the upper-semicontinuous functions $u:X\longrightarrow [0,1]$ with compact support and such that $u^{-1}(\{1\})\neq\varnothing$. In particular, we characterize the properties of topological and multiple recurrence for the extended systems $(\mathcal{K}(X),\overline{f})$ and $(\mathcal{F}(X),\hat{f})$. Special attention is given to the case where the underlying space is completely metrizable, for which we obtain some stronger point-recurrence equivalences.


title: On Some Nonlocal in Time and Space Parabolic Problem

abstract: The goal of this note is to study nonlinear parabolic problems nonlocal in time and space. We first establish the existence of a solution and its uniqueness in certain cases. Finally we consider its asymptotic behaviour.


title: Parabolic vector bundles and Lie algebroid connections

abstract: Given a holomorphic Lie algebroid on an m-pointed Riemann surface, we define parabolic Lie algebroid connections on any parabolic vector bundle equipped with parabolic structure over the marked points. An analogue of the Atiyah exact sequence for parabolic Lie algebroids is constructed. For any Lie algebroid whose underlying holomorphic vector bundle is stable, we give a complete characterization of all the parabolic vector bundles that admit a parabolic Lie algebroid connection.


title: MVOC: a training-free multiple video object composition method with diffusion models

abstract: Video composition is the core task of video editing. Although image composition based on diffusion models has been highly successful, it is not straightforward to extend the achievement to video object composition tasks, which not only exhibit corresponding interaction effects but also ensure that the objects in the composited video maintain motion and identity consistency, which is necessary to composite a physical harmony video. To address this challenge, we propose a Multiple Video Object Composition (MVOC) method based on diffusion models. Specifically, we first perform DDIM inversion on each video object to obtain the corresponding noise features. Secondly, we combine and edit each object by image editing methods to obtain the first frame of the composited video. Finally, we use the image-to-video generation model to composite the video with feature and attention injections in the Video Object Dependence Module, which is a training-free conditional guidance operation for video generation, and enables the coordination of features and attention maps between various objects that can be non-independent in the composited video. The final generative model not only constrains the objects in the generated video to be consistent with the original object motion and identity, but also introduces interaction effects between objects. Extensive experiments have demonstrated that the proposed method outperforms existing state-of-the-art approaches. Project page: https://sobeymil.github.io/mvoc.com.


title: Moyal product and Generalized Hom-Lie-Virasoro symmetries in Bloch electron systems

abstract: We explore two variations of the Curtright-Zachos (CZ) deformation of the Virasoro algebra. Firstly, we introduce a scaled CZ algebra that inherits the scaling structure found in the differential operator representation of the magnetic translation (MT) operators. We then linearly decompose the scaled CZ generators to derive two types of Hom-Lie deformations of the W-infinity algebra. We discuss *-bracket formulations of these algebras and their connection to the Moyal product. We show that the *-bracket form of the scaled CZ algebra arises from the Moyal product, while we obtain the second type of deformed W-infinity through a coordinate transformation of the first type of Moyal operators. From a physical point of view, we construct the Hamiltonian of a tight binding model (TBM) using the Wyle matrix representation of the scaled CZ algebra. We note that the integer powers of q are linked to the quantum fluctuations that are inherent in the Moyal product.


title: Shape2.5D: A Dataset of Texture-less Surfaces for Depth and Normals Estimation

abstract: Reconstructing texture-less surfaces poses unique challenges in computer vision, primarily due to the lack of specialized datasets that cater to the nuanced needs of depth and normals estimation in the absence of textural information. We introduce "Shape2.5D," a novel, large-scale dataset designed to address this gap. Comprising 364k frames spanning 2635 3D models and 48 unique objects, our dataset provides depth and surface normal maps for texture-less object reconstruction. The proposed dataset includes synthetic images rendered with 3D modeling software to simulate various lighting conditions and viewing angles. It also includes a real-world subset comprising 4672 frames captured with a depth camera. Our comprehensive benchmarks, performed using a modified encoder-decoder network, showcase the dataset's capability to support the development of algorithms that robustly estimate depth and normals from RGB images. Our open-source data generation pipeline allows the dataset to be extended and adapted for future research. The dataset is publicly available at \url{https://github.com/saifkhichi96/Shape25D}.


title: Comparing sampling techniques to chart parameter space of 21 cm Global signal with Artificial Neural Networks

abstract: Understanding the first billion years of the universe requires studying two critical epochs: the Epoch of Reionization (EoR) and Cosmic Dawn (CD). However, due to limited data, the properties of the Intergalactic Medium (IGM) during these periods remain poorly understood, leading to a vast parameter space for the global 21cm signal. Training an Artificial Neural Network (ANN) with a narrowly defined parameter space can result in biased inferences. To mitigate this, the training dataset must be uniformly drawn from the entire parameter space to cover all possible signal realizations. However, drawing all possible realizations is computationally challenging, necessitating the sampling of a representative subset of this space. This study aims to identify optimal sampling techniques for the extensive dimensionality and volume of the 21cm signal parameter space. The optimally sampled training set will be used to train the ANN to infer from the global signal experiment. We investigate three sampling techniques: random, Latin Hypercube (stratified), and Hammersley Sequence (quasi-Monte Carlo) sampling, and compare their outcomes. Our findings reveal that sufficient samples must be drawn for robust and accurate ANN model training, regardless of the sampling technique employed. The required sample size depends primarily on two factors: the complexity of the data and the number of free parameters. More free parameters necessitate drawing more realizations. Among the sampling techniques utilized, we find that ANN models trained with Hammersley Sequence sampling demonstrate greater robustness compared to those trained with Latin Hypercube and Random sampling.


title: XBG: End-to-end Imitation Learning for Autonomous Behaviour in Human-Robot Interaction and Collaboration

abstract: This paper presents XBG (eXteroceptive Behaviour Generation), a multimodal end-to-end Imitation Learning (IL) system for a whole-body autonomous humanoid robot used in real-world Human-Robot Interaction (HRI) scenarios. The main contribution of this paper is an architecture for learning HRI behaviours using a data-driven approach. Through teleoperation, a diverse dataset is collected, comprising demonstrations across multiple HRI scenarios, including handshaking, handwaving, payload reception, walking, and walking with a payload. After synchronizing, filtering, and transforming the data, different Deep Neural Networks (DNN) models are trained. The final system integrates different modalities comprising exteroceptive and proprioceptive sources of information to provide the robot with an understanding of its environment and its own actions. The robot takes sequence of images (RGB and depth) and joints state information during the interactions and then reacts accordingly, demonstrating learned behaviours. By fusing multimodal signals in time, we encode new autonomous capabilities into the robotic platform, allowing the understanding of context changes over time. The models are deployed on ergoCub, a real-world humanoid robot, and their performance is measured by calculating the success rate of the robot's behaviour under the mentioned scenarios.


title: Colliding Gravitino Plane Waves in Simple Supergravity

abstract: We give a family of exact solutions of $N=1$ supergravity field equations in $D=4$ dimensions that describe the collision of plane-fronted gravitino waves.


title: Alternating-Chiral Charge Density Waves and Hybrid Ferrimagnetism in Monolayered NbTe2

abstract: Intertwining of different quantum degrees of freedom manifests exotic quantum phenomena in many-body systems, especially in reduced dimensionality. Here we show that monolayered NbTe2 serves as an ideal platform where lattice, charge, and spin degrees of freedom manifest cooperatively, leading to a new and threading order of chirality. By using spin-polarized scanning tunneling microscopy/spectroscopy, we reveal that the root19 * root19 phase of NbTe2 is encoded with both alternating-chiral atomic displacements and charge density waves, characterized by two chiral units of opposite handedness within the reconstructed cell. We show unambiguous evidence for emergent spin polarizations spreading over the primitive cell, with the magnetization orientation synchronized with alternating handedness of chiral order. Our first-principles studies identify the origin of intertwined orders being correlation driven, with the threading order of chirality emerging when the on-site Coulomb repulsion exceeds a critical value. The spin ordering is further shown to be of hybrid ferrimagnetic nature, contributed by the itinerant electrons and localized d-orbitals. Collectively, these findings expand the realm of chiral order in correlated electron systems, and facilitate an appealing platform for chiral spintronic and related applications.


title: Decentralized Transformers with Centralized Aggregation are Sample-Efficient Multi-Agent World Models

abstract: Learning a world model for model-free Reinforcement Learning (RL) agents can significantly improve the sample efficiency by learning policies in imagination. However, building a world model for Multi-Agent RL (MARL) can be particularly challenging due to the scalability issue in a centralized architecture arising from a large number of agents, and also the non-stationarity issue in a decentralized architecture stemming from the inter-dependency among agents. To address both challenges, we propose a novel world model for MARL that learns decentralized local dynamics for scalability, combined with a centralized representation aggregation from all agents. We cast the dynamics learning as an auto-regressive sequence modeling problem over discrete tokens by leveraging the expressive Transformer architecture, in order to model complex local dynamics across different agents and provide accurate and consistent long-term imaginations. As the first pioneering Transformer-based world model for multi-agent systems, we introduce a Perceiver Transformer as an effective solution to enable centralized representation aggregation within this context. Results on Starcraft Multi-Agent Challenge (SMAC) show that it outperforms strong model-free approaches and existing model-based methods in both sample efficiency and overall performance.


title: The Reasonable Ineffectiveness of Aesthetics in Particle Physics

abstract: In recent years, criticism of the methodology of particle physics beyond the Standard Model has increased, diagnosing too much reliance on aesthetic criteria for theory development and evaluation. Faced with several decades of experimental confirmation of all theories lacking, we subject four aesthetic criteria - simplicity, symmetry, elegance, and inevitability -, regularly mentioned in theory evaluation, to critical examination. We find that these criteria, all of which can be reduced to a desire for simplicity, have repeatedly misled modern particle physics. This is largely due to the lack of metatheoretical permanence of a uniform conception of simplicity. The reductionist claim of particle physics - the search for simple fundamental principles in a complex world - will be worked out as the reason why this discipline is particularly susceptible to the aesthetic appeal of simplicity. Thus, compared to disciplines dealing with complex phenomena, aesthetic criteria are much more frequently applied, exposing particle physics to the risk of missteps and dead ends.


title: A frame-bundle formulation of quantum reference frames: from superposition of perspectives to superposition of geometries

abstract: We provide a possible fully geometric formulation of the core idea of quantum reference frames (QRFs) as it has been applied in the context of gravity, freeing its definition from unnecessary (though convenient) ingredients, such as coordinate systems. Our formulation is based on two main ideas. First, a QRF encodes uncertainty about what is the observer's (and, hence, the measuring apparatus's) perception of time and space at each spacetime point (i.e., event). For this, an observer at an event $p$ is modeled, as usual, as a tetrad in the tangent space $T_p$. So a QRF at an event $p$ is a complex function on the tetrads at $p$. Second, we use the result that one can specify a metric on a given manifold by stipulating that a basis one assigns at each tangent space is to be a tetrad in the metric one wants to specify. Hence a spacetime, i.e. manifold plus metric, together with a choice of "point of view" on it, is represented by a section of the bundle of bases, understood as taking the basis assigned to each point to be a tetrad. Thus a superposition of spacetimes gets represented as, roughly speaking, an assignment of complex amplitudes to sections of this bundle. A QRF, defined here as the collection of complex amplitudes assigned to bases at events--i.e., a complex function defined on the bundle of bases of the manifold--can describe, in a local way (i.e., attributing the amplitudes to bases at events instead of to whole sections), these superpositions. We believe that this formulation sheds some light on some conceptual aspects and possible extensions of current ideas about QRFs. For instance, thinking in geometric terms makes it clear that the idea of QRFs applied to the gravitational scenarios treated in the literature (beyond linear approximation) lacks predictive power due to arbitrariness which, we argue, can only be resolved by some further input from physics.


title: The Effect of Similarity Measures on Accurate Stability Estimates for Local Surrogate Models in Text-based Explainable AI

abstract: Recent work has investigated the vulnerability of local surrogate methods to adversarial perturbations on a machine learning (ML) model's inputs, where the explanation is manipulated while the meaning and structure of the original input remains similar under the complex model. While weaknesses across many methods have been shown to exist, the reasons behind why still remain little explored. Central to the concept of adversarial attacks on explainable AI (XAI) is the similarity measure used to calculate how one explanation differs from another A poor choice of similarity measure can result in erroneous conclusions on the efficacy of an XAI method. Too sensitive a measure results in exaggerated vulnerability, while too coarse understates its weakness. We investigate a variety of similarity measures designed for text-based ranked lists including Kendall's Tau, Spearman's Footrule and Rank-biased Overlap to determine how substantial changes in the type of measure or threshold of success affect the conclusions generated from common adversarial attack processes. Certain measures are found to be overly sensitive, resulting in erroneous estimates of stability.


title: Asymptotics for Some Logistic Maps and the Renormalization Group

abstract: We explain the relation between the $r=1$ logistic map $x_{i+1}=rx_i(1-x_i)$, $x_i\in\mathbb R$, $i=0,1,\ldots$, $r>0$ and $x_0\geq0$, and the RG flow in the multiscale analysis of zero fixed point, asymptotic free QFT models as e.g. the ultraviolet (1+1)-dimensional Gross-Neveu model and QCD, and the infrared $\phi^4_4$. We obtain the asymptotics of the mapping, showing an inverse power decay to the fixed point $x^*=0$ Gaussian fixed point, with logarithmic-like corrections. This asymptotics is independent of the initial condition $x_0\in(0,1)$ (so, there is no constraint for $x_0$ to be small, as usual in QFT models), and only depends on the lowest orders in a polynomial perturbation. In asymptotic free QFT, this means that knowing the RG $\beta$ function expansion up to higher orders in the coupling does not improve our knowledge of the flow asymptotics. A comparison with an ODE with continuous time is made by analyzing stability of the solution with higher order monomial perturbations. We also obtain the asymptotics for $0<r<1$. Also, our methods work when $r\in(1,3]$. It is known, but without detailed asymptotics, that all trajectories with initial condition $x_0\in(-1,1)$ converge to the fixed point $x^*=(r-1)/r$. For the super attractive case $r=2$, we obtain an explicit exact solution with an exploding nonconstant exponential decay rate to the $x^*=1/2$ fixed point. Our methods include the use of iterations, a discrete version of the Fundamental Theorem of Calculus, a discrete version of the integrating factor method for 1st order linear ODEs and, sometimes, a scaling transformation. We do not use the Banach contraction mapping theorem, which only provides an upper bound on the asymptotics. We expect that our methods apply to determine the asymptotics of the logistic map for a wider range of parameters, where other fixed points are present.